Goto

Collaborating Authors

 human extinction


More Anthropic researchers warn of AI's perils as Musk terms fears a 'psyop'

The Guardian

More Anthropic researchers warn of AI's perils as Musk terms fears a'psyop' Insiders at the firm fear tech's advancement could cause human extinction while others are calling it a'setup' A day after a former researcher at Anthropic made an apocalyptic declaration about artificial intelligence, more researchers and staff members at the AI startup publicly agreed with him and posted their own dire warnings. In response, Elon Musk and other conservative figures on X, formerly Twitter, called the chorus of concerns a "setup" and a "psyop". The Anthropic insiders fear the technology they are building could become so advanced and dangerous as to cause human extinction within the decade, and they assert many of their colleagues feel the same but haven't said so publicly. These researchers and staff are posting in response to a now-viral thread from Anthropic researcher Jacob Coxon, who said on Wednesday he was resigning from the company because neither Anthropic nor its competitor OpenAI, also his former employer, were building AI models responsibly and are "gambling with our lives". OpenAI not on track to reduce risk of'catastrophic' loss of control, says board member Anna Wang, who works on Artificial General Intelligence Safety at Anthropic and previously worked at Google's DeepMind, said Thursday that many people at Anthropic want to slow down development to come up with a plan to mitigate the risks that could come with these AI models.


Lawmakers blast AI companies after researcher warns of human extinction by 2030

The Guardian

'A recent poll shows that the American people overwhelmingly want to ban artificial super intelligence and pause the development of AI until we establish clear safety standards.' 'A recent poll shows that the American people overwhelmingly want to ban artificial super intelligence and pause the development of AI until we establish clear safety standards.' Former Anthropic employee Jacob Coxon said AI will become'superhuman systems' that can cause human extinction by the end of the decade Just a day after three Anthropic researchers warned that artificial intelligence could kill off humanity within the decade, lawmakers have begun lashing out about the risks of the burgeoning technology. Ted Cruz, a republican senator from Texas, said in an interview on ABC's The View, that AI poses a "catastrophic risk" and that he "read that whole tweet thread that that developer put out. "It reminded me, last year I had Elon Musk on my podcast and one of the questions I asked him, I said, 'OK, what are the odds that AI destroys humanity?'


'Godfather of AI' warns superintelligent systems could 'lead to human extinction' - as he calls for the government to ban their development

Daily Mail - Science & tech

You're viewing the US edition You can switch to the UK or AU homepage at any time using this menu. Beautiful young doctor vanished on 9/11... then a fake final phone call, secret double life and video three minutes before first plane hit raised haunting questions Midwest mom in'Lindsay Clancy group chat' had psychotic break when she allegedly murdered her son, 2, lawyer says Trump's Cabinet secretary lets slip what president would rather do than talk about Iran Shocking moment group are kicked out of Portland women's sports bar for wearing'Save Women's Sports' shirts Truth about the Falling Man: Sister of anonymous 9/11 jumper who became symbol of America's grief tells the heartbreaking full story, clues that led to him... and why she knows God'caught his spirit' and carried it to Heaven Jennifer Lopez's provocative behavior is raising eyebrows in the Hollywood cruel crowd but I know her well enough to spill the truth: ROB SHUTER Kim Zolciak's jailed son KJ, 15, may face harsh conditions if he's released on bond after indictment on multiple charges in sexual assault case If Lindsay Clancy cared about the children she killed, she wouldn't be able to live. Read precisely what she did in those 45 minutes of evil... and see if you still believe her: MAUREEN CALLAHAN Glamorous Egyptian TV star pleaded for mercy and screamed'I've never even smoked a cigarette' as she was sentenced to death on drug charges Bill Belichick breaks silence on UNC scandal as investigators probe son's alleged drug use and sexual player-staff relationships after shock report As an atheist, I expected oblivion... but I entered the afterlife for six minutes and saw proof of what God is REALLY like. Woman told boyfriend that her ex was a better lover than him... so he did the unthinkable to her and her children, police say I've seen age-gap relationships and the horrifying toll they can take. This is the conversation couples must have - you can't delay: DR MAX PEMBERTON'Godfather of AI' warns superintelligent systems could'lead to human extinction' - as he calls for the government to ban their development The man dubbed the'godfather of AI ' has issued a warning over powerful artificial intelligence systems.


Will it take a 'Chernobyl-scale disaster' for us to regulate cyber weapons of mass destruction? Stuart Russell

The Guardian

'The CEOs are telling us, "We're on track to create superhuman intelligence, which has a good chance of causing human extinction."' 'The CEOs are telling us, "We're on track to create superhuman intelligence, which has a good chance of causing human extinction."' Will it take a'Chernobyl-scale disaster' for us to regulate cyber weapons of mass destruction? T he AI company Anthropic has been making major headlines recently. Its trillion-dollar IPO plan and its blood feud with secretary of defense Pete Hegseth have attracted much attention, but two other events may be even more consequential.


The Strange Disappearance of an Anti-AI Activist

The Atlantic - Technology

Sam Kirchner wants to save the world from artificial superintelligence. He's been missing for two weeks. B efore Sam Kirchner vanished, before the San Francisco Police Department began to warn that he could be armed and dangerous, before OpenAI locked down its offices over the potential threat, those who encountered him saw him as an ordinary, if ardent, activist. Phoebe Thomas Sorgen met Kirchner a few months ago at Travis Air Force Base, northeast of San Francisco, at a protest against immigration policy and U.S. military aid to Israel. Sorgen, a longtime activist whose first protests were against the Vietnam War, was going to block an entrance to the base with six other older women. Kirchner, 27 years old, was there with a couple of other members of a new group called Stop AI, and they all agreed to go along to record video on their phones in case of a confrontation with the police.


Who finds dad jokes funniest? The answer might not astonish you

New Scientist

Who finds dad jokes funniest? Feedback had a birthday within the past 12 months, and Feedback Jr gave us a card that read: "My ambition in life is to be as funny as you think you are." Still, we persist with our dad jokes, if only because our offspring's exasperated reactions are so much fun. So we were delighted to learn that two psychologists, Paul Silvia and Meriel Burnett, have taken a scholarly interest in dad jokes. They have written an entire paper on the topic.


The Paradox of Doom: Acknowledging Extinction Risk Reduces the Incentive to Prevent It

arXiv.org Artificial Intelligence

We investigate the salience of extinction risk as a source of impatience. Our framework distinguishes between human extinction risk and individual mortality risk while allowing for various degrees of intergenerational altruism. Additionally, we consider the evolutionarily motivated "selfish gene" perspective. We find that the risk of human extinction is an indispensable component of the discount rate, whereas individual mortality risk can be hedged against - partially or fully, depending on the setup - through human reproduction. Overall, we show that in the face of extinction risk, people become more impatient rather than more farsighted. Thus, the greater the threat of extinction, the less incentive there is to invest in avoiding it. Our framework can help explain why humanity consistently underinvests in mitigation of catastrophic risks, ranging from climate change mitigation, via pandemic prevention, to addressing the emerging risks of transformative artificial intelligence.


A Taxonomy of Omnicidal Futures Involving Artificial Intelligence

arXiv.org Artificial Intelligence

This report presents a taxonomy and examples of potential omnicidal events resulting from AI: scenarios where all or almost all humans are killed. These events are not presented as inevitable, but as possibilities that we can work to avoid. Insofar as large institutions require a degree of public support in order to take certain actions, we hope that by presenting these possibilities in public, we can help to support preventive measures against catastrophic risks from AI.


The Economics of p(doom): Scenarios of Existential Risk and Economic Growth in the Age of Transformative AI

arXiv.org Artificial Intelligence

Recent advances in artificial intelligence (AI) have led to a diverse set of predictions about its long-term impact on humanity. A central focus is the potential emergence of transformative AI (TAI), eventually capable of outperforming humans in all economically valuable tasks and fully automating labor. Discussed scenarios range from human extinction after a misaligned TAI takes over ("AI doom") to unprecedented economic growth and abundance ("post-scarcity"). However, the probabilities and implications of these scenarios remain highly uncertain. Here, we organize the various scenarios and evaluate their associated existential risks and economic outcomes in terms of aggregate welfare. Our analysis shows that even low-probability catastrophic outcomes justify large investments in AI safety and alignment research. We find that the optimizing representative individual would rationally allocate substantial resources to mitigate extinction risk; in some cases, she would prefer not to develop TAI at all. This result highlights that current global efforts in AI safety and alignment research are vastly insufficient relative to the scale and urgency of existential risks posed by TAI. Our findings therefore underscore the need for stronger safeguards to balance the potential economic benefits of TAI with the prevention of irreversible harm. Addressing these risks is crucial for steering technological progress toward sustainable human prosperity.


There Is a Solution to AI's Existential Risk Problem

TIME - Tech

Technological progress can excite us, politics can infuriate us, and wars can mobilize us. But faced with the risk of human extinction that the rise of artificial intelligence is causing, we have remained surprisingly passive. In part, perhaps this was because there did not seem to be a solution. This is an idea I would like to challenge. Since the release of ChatGPT two years ago, hundreds of billions of dollars have poured into AI.